Neural associative memories and sparse coding
نویسنده
چکیده
The theoretical, practical and technical development of neural associative memories during the last 40 years is described. The importance of sparse coding of associative memory patterns is pointed out. The use of associative memory networks for large scale brain modeling is also mentioned.
منابع مشابه
A study of retrieval algorithms of sparse messages in networks of neural cliques
-Associative memories are data structures addressed using part of the content rather than an index. They offer good fault reliability and biological plausibility. Among different families of associative memories, sparse ones are known to offer the best efficiency (ratio of the amount of bits stored to that of bits used by the network itself). Their retrieval process performance has been shown t...
متن کاملHierarchical Associative Memories and Sparse Coding
Several models for artificial neural networks are found in the literature to implement associative memories. We describe two of them (the Lernmatrix ([10]) and a Hierarchical Associative Memory model ([7]). We focus particularly on the second, which consists in a multi-layered hierarchy of matrices based on Lernmatrix, where matrices in lower positions in the hierarchy act as selective filters ...
متن کاملHuffman Coding for Storing Non-Uniformly Distributed Messages in Networks of Neural Cliques
Associative memories are data structures that allow retrieval of previously stored messages given part of their content. They thus behave similarly to human brain’s memory that is capable for instance of retrieving the end of a song given its beginning. Among different families of associative memories, sparse ones are known to provide the best efficiency (ratio of the number of bits stored to t...
متن کاملBAM Learning in High Level of Connection Sparseness
Bidirectional Associative Memories (BAMs) are artificial neural networks that can learn and recall various types of associations. Although BAMs have shown great promise at modeling human cognitive processes, these models have often been investigated under optimal conditions in which the network is fully connected. Whereas some BAM models have shown to be robust to connection sparseness, those p...
متن کاملIterative Retrieval in Associative Memories by Threshold Control of Different Neural Models
We investigate the retrieval properties of Hebbian auto-associative memories in the limit of sparse coding. Appropriately chosen threshold control strategies in nite size associa-tive memories increase the completion capacity for iterative retrieval (and even for the very fast two-step retrieval) above the asymptotic capacity for extremely large networks. We relate these results to a biological...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neural networks : the official journal of the International Neural Network Society
دوره 37 شماره
صفحات -
تاریخ انتشار 2013